Transformers as a substrate for structural biology

Abstract

Transformers are rapidly reshaping structural biology. We argue the reason is “Emergent Latent Biology” (ELB): transformers place proteins into high-dimensional representations where hidden biophysical patterns become easier to see. We explore this concept across four key areas: protein folding, variant effects, protein–protein and protein–drug interactions. Highlighting recent gains, we note that traditional, physics-based calculations are still required for the hardest quantitative jobs, like predicting precise binding strength. Furthermore, we draw attention to major pitfalls, arguing progress depends on solving the critical “chemistry gap,” modelling chemical modifications, and the “dyna..